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Abstract.  In  this  paper  we  consider  ad-hoc  networks  of  robotic  agents  with  double  integrator 
dynamics.  For  such  networks,  the  connectivity  maintenance  problems  are:  (i)  do  there  exist  control 
inputs  for  each  agent  to  maintain  network  connectivity,  and  (ii)  given  desired  controls  for  each 
agent,  can  one  compute  the  closest  connectivity-maintaining  controls  in  a  distributed  fashion?  The 
proposed  solution  is  based  on  three  contributions.  First,  we  define  and  characterize  admissible  sets 
for  double  integrators  to  remain  inside  disks.  Second,  we  establish  an  existence  theorem  for  the 
connectivity  maintenance  problem  by  introducing  a  novel  state-dependent  graph,  called  the  double¬ 
integrator  disk  graph.  Finally,  we  design  a  distributed  “flow- control”  algorithm  to  compute  optimal 
connectivity- maintaining  controls. 


1.  Introduction.  This  work  is  a  contribution  to  the  emerging  discipline  of  mo¬ 
tion  coordination  for  ad-hoc  networks  of  mobile  autonomous  agents.  This  loose  ter¬ 
minology  refers  to  groups  of  robotic  agents  with  limited  mobility  and  communica¬ 
tion  capabilities.  In  the  not  too  distant  future,  these  groups  of  coordinated  devices 
will  perform  a  variety  of  challenging  tasks  including  search  and  recovery  operations, 
surveillance,  exploration  and  environmental  monitoring.  The  potential  advantages  of 
employing  arrays  of  agents  have  recently  motivated  vast  interest  in  this  topic.  For 
example,  from  a  control  viewpoint,  a  group  of  agents  inherently  provides  robustness 
to  failures  of  single  agents  or  of  communication  links. 

The  motion  coordination  problem  for  groups  of  autonomous  agents  is  a  control 
problem  in  the  presence  of  communication  constraints.  Typically,  each  agent  makes 
decisions  based  only  on  partial  information  about  the  state  of  the  entire  network 
that  is  obtained  via  communication  with  its  immediate  neighbors.  One  important 
difficulty  is  that  the  topology  of  the  communication  network  depends  on  the  agents’ 
locations  and,  therefore,  changes  with  the  evolution  of  the  network.  In  order  to  ensure 
a  desired  emergent  behavior  for  a  group  of  agents,  it  is  necessary  that  the  group  does 
not  disintegrate  into  subgroups  that  are  unable  to  communicate  with  each  other. 
In  other  words,  some  restrictions  must  be  applied  on  the  movement  of  the  agents 
to  ensure  connectivity  among  the  members  of  the  group.  In  terms  of  design,  it  is 
required  to  constrain  the  control  input  such  that  the  resulting  topology  maintains 
connectivity  throughout  its  course  of  evolution.  In  [2] ,  a  connectivity  constraint  was 
developed  for  a  group  of  agents  modeled  as  first-order  discrete  time  dynamic  systems. 
In  [2]  and  in  the  related  references  [3,  4],  this  constraint  is  used  to  solve  rendezvous 
problems.  Connectivity  constraints  for  line-of-sight  communication  are  proposed  in 
[5] .  Another  approach  to  connectivity  maintenance  for  first-order  systems  is  proposed 
in  [6].  In  [7],  a  centralized  procedure  to  find  the  set  of  control  inputs  that  maintain 
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/c-hop  connectivity  for  a  network  of  agents  is  given.  However,  there  is  no  guarantee 
that  the  resulting  set  of  feasible  control  inputs  in  non-empty.  In  this  paper  we  fully 
characterize  the  set  of  admissible  control  inputs  for  a  group  of  agents  modeled  as 
second  order  discrete  time  dynamic  systems,  which  ensures  connectivity  of  the  group 
in  the  same  spirit  as  described  earlier. 

The  contributions  of  the  paper  are  threefold.  First,  we  consider  a  control  system 
consisting  of  a  double  integrator  with  bounded  control  inputs.  For  such  a  system, 
we  define  and  characterize  the  admissible  set  that  allows  the  double  integrator  to 
remain  inside  disks.  Second,  we  define  a  novel  state-dependent  graph  -  the  double¬ 
integrator  disk  graph  -  and  give  an  existence  theorem  for  the  connectivity  maintenance 
problem  for  networks  of  second  order  agents  with  respect  to  an  appropriate  version 
of  this  new  graph.  Finally,  we  consider  a  relevant  optimization  problem,  where  given 
a  set  of  desired  control  inputs  for  all  the  agents  it  is  required  to  find  the  optimal 
set  of  connectivity-maintaining  control  inputs.  We  cast  this  problem  into  a  standard 
quadratic  programming  problem  and  provide  a  distributed  “flow-control”  algorithm 
to  solve  it. 

The  paper  is  organized  as  follows.  In  Section  2,  we  define  and  characterize  the 
admissible  sets  for  a  double  integrator  to  remain  inside  a  disk  and  based  on  this  we 
define  a  new  graph  -  the  double-integrator  disk  graph.  In  Section  3,  we  provide  an 
existence  theorem  for  the  set  of  control  inputs  for  the  whole  network  of  second  order 
agents  that  maintains  connectivity  with  respect  to  an  appropriately  scaled  version  of 
this  new  graph.  We  also  characterize  and  give  an  inner  polytopic  representation  of 
the  constraint  set  for  these  connectivity-maintaining  control  inputs.  In  Section  4,  we 
consider  the  problem  of  searching  this  constraint  set  for  the  optimal  set  of  controls 
in  a  distributed  way.  Section  5  has  some  illustrative  simulations  which  also  suggest 
an  alternative  way  of  achieving  a  weak  form  of  flocking  of  the  agents.  Finally  we 
conclude  with  a  few  remarks  about  future  work  in  Section  6. 

2.  Preliminary  developments.  We  begin  with  some  notations.  We  let  N, 
No,  and  R+  denote  the  natural  numbers,  the  non- negative  integer  numbers,  and  the 
positive  real  numbers,  respectively.  For  d  £  N,  we  let  0^  and  1^  denote  the  vectors  in 
Rd  whose  entries  are  all  0  and  1,  respectively.  We  let  ||p||  denote  the  Euclidean  norm 
of  p  £  Rd.  For  r  £  R+  and  p  £  Rd,  we  let  B(p,  r)  denote  the  closed  ball  centered  at 
p  with  radius  r,  i.e.,  B(p,r)  =  {q  £  Rd  |  \\p  —  q||  <  r}.  For  x,y  £  Rd,  we  let  x  R  y 
denote  component-wise  inequality,  i.e.,  Xk  <  yk  for  k  £  {1, . . . ,  d}.  We  let  /  :  A  =4  B 
denote  a  set-valued  map;  in  other  words,  for  each  a  £  A,  f(a)  is  a  subset  of  B.  We 
identify  Rd  x  Rd  with  R2d. 

2.1.  Maintaining  a  double  integrator  inside  a  disk.  For  t  £  No,  consider 
the  discrete-time  control  system  in  R2d 

p[t  +  1}  =  p[t\  +  v[t], 
v[t  +  1]  =  v[t]  +  u[t ], 

where  the  norm  of  the  control  is  upper-bounded  by  rctr  £  R+,  i.e.,  u[t]  £  B(0d,  rctr)  for 
t  £  No-  We  refer  to  this  control  system  as  the  discrete-time  double  integrator  in  Md  or, 
more  loosely,  as  a  second-order  system.  Given  (p,  v)  £  R2d  and  {ur}rSN0  C  B(0d,  rctr)> 
let  </>(£,  (p,v),  {iiT})  denote  the  solution  of  (2.1)  at  time  £  £  No  from  initial  condition 
(j>,  v )  with  inputs  Ui, ... ,  Ut~\. 

In  what  follows  we  consider  the  following  problem:  assume  that  the  initial  position 
of  (2.1)  is  inside  a  disk  centered  at  0^,  find  inputs  that  keep  it  inside  that  disk.  This 
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task  is  impossible  for  general  values  of  the  initial  velocity.  In  what  follows  we  identify 
assumptions  on  the  initial  velocity  that  render  the  task  possible. 

For  rpos  G  R+,  we  define  the  admissible  set  at  time  zero  by 

“4o(rpos)  =  B(0d,  rpos)  x  R  . 

For  rpos,  rctr  G  R+,  we  define  the  admissible  set  for  m  time  steps  by 

“^m(^pos;  7"ctr)  =  {(PjW)  €  R  I  3{ltT }Tg[Qjm_i]  C  -B(0d,rctr) 

s.t.  0(i,  ip,v),{uT})  G  ^o(rpos)  Vt  G  [0,  m]}, 

and  the  admissible  set  by 

Ad(rpos,rctl)  =  {(p,v)  G  R2d  |  3{ur}TeNo  C  B(0d,rctr) 

s.t.  4>(t,(p,v),{uT})  £  Ao{rpos),  VtGNo}. 

With  slight  abuse  of  notation  we  shall  sometimes  suppress  the  arguments  in  the  defini¬ 
tions  of  admissible  sets.  The  following  theorem  establishes  some  important  properties 
of  the  admissible  sets. 

Theorem  2.1  (Properties  of  the  admissible  sets).  For  all  d  G  N  and  rpos,rctr  G 
R+,  the  following  statements  hold: 

(i)  for  all  me  N,  w4^(rpos,  rctr)  £  ^m-i(rPos,  rctr)  and 

-A  (^Pos7^*ctr)  —  lim  ^m(^Pos?  ^ctr)  —  lilll  i  (^pos,  T’ctr)  5 

m — ^+00  m — >+00 

(a)  Ad(rpos,rctT)  is  a  convex,  compact  set  and  is  the  largest  controlled-invariant 1 2 
subset  of  _4q(7-pos); 

(Hi)  Ad(rpos,rctT)  is  invariant  under  orthogonal  transformations  in  the  sense  that, 
if  (Pi v)  G  -4d(rpos,  rctr);  then  also  ( Rp ,  Rv )  G  -4d(rp0s,  rctr)  for  all  orthogonaP 
matrices  R  in  Rdxd; 

(iv)  if  0  <  n  <  r2,  then  Ad(rpos,ri)  C  Ad{rpos,r2)  and  Ad{n,  rctr)  C  Ad(r2,  rctl). 

Proof.  The  two  facts  in  statement  (i)  are  direct  consequences  of  the  definitions 
of  Af  and  Ad.  Regarding  statement  (ii),  each  Af,  m  G  N,  is  closed,  the  intersection 
of  closed  sets  is  closed,  and,  therefore,  Ad  =  limm_+OC!  (~I^L1  Af  is  closed.  To  show 
that  Ad  is  bounded  it  suffices  to  show  that  Af  is  bounded.  Note  that  (p,  v)  G  Af 
implies  that  there  exists  u  G  B(0d,  rctr)  such  that  (p,  v )  G  Af  and  (p  +  v,  v  +  u)  G  Af. 
This,  in  turn,  implies  that  p  G  B(0d,  rpos)  and  p  +  v  G  B(0d,  rpos).  Therefore,  Af  is 
bounded.  Next,  we  prove  that  Af,  is  convex.  Given  and  (p2,v2)  in  Af,,  let  U\ 

and  u2  be  controls  that  ensure  that  <j>{t,  ( Pi,Vi ),  {iq})  G  Af,  t  G  [0,  to],  i  G  {1,  2}.  For 
A  G  [0, 1],  consider  the  initial  condition  (p\,  v\)  =  (Apr  +  (1  —  X)p2,Xv\  +  (1  —  X)v2) 
and  the  input  u\  =  Xui  +  (1  —  X)u2,  and  note  that,  by  linearity, 

(fit,  (pA,  v\),  ux)  =  X (fit,  (pi,  ui),  {ui})  +  (1  -  X)(j>{t,  (p2,v2),  { u2 }),  t  G  [0,  m\. 

Because  cj>(t,  (pi,  v\),  {ui})  and  (fit,  {p2,v2),{u2})  belong  to  the  convex  set  Af,  then 
also  their  convex  combination  does.  Therefore,  {p\,v\)  belongs  to  Af,,  and  Af,  is 
convex.  Finally,  Ad  is  convex  because  the  intersection  of  convex  sets  is  convex. 

1A  set  is  controlled  invariant  for  a  control  system  if  there  exists  a  feedback  law  such  that  the  set 
is  positively  invariant  for  the  closed-loop  system. 

2 A  matrix  R  E  Rdxd  is  orthogonal  if  RRT  =  RT R  =  I 
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Next,  we  show  that  Ad  is  controlled  invariant.  Given  (j>,v)  £  Ad  (with  corre¬ 
sponding  control  sequence  {uT}rSN0)i  we  need  to  show  that  there  exists  a  control 
input  x  £  B( Od,rctr)  such  that  c/>(l,(p,v),x)  £  Ad.  Such  input  can  be  chosen  as 
x  =  uq.  Indeed,  the  control  sequence  {itr+i}reN0  keeps  the  trajectory  starting  from 
<j>(  1,  (p,  v),  x)  inside  Aq  and,  therefore,  <(>(1,  (p,  v),  x)  £  Ad.  Additionally,  it  is  easy  to 
see  that  Ad  C  Aq.  Finally,  we  need  to  prove  that  Ad  is  the  largest  controlled-invariant 
subset  of  Aq.  Assume  that  there  exists  Ad*  with  the  same  properties  and  larger  than 
Ad .  This  means  that  there  exists  (p,  v )  £  Ad *  \  Ad.  This  is  equivalent  to  saying  that 
3  r*  £  No  such  that,  for  every  choice  of  the  input  u,  ( p,v),u )  ^  Aq.  But,  since 

Ad*  C  Aq}  this  leads  to  a  contradiction. 

Regarding  statement  (iii),  observe  that,  if  (j>,v)  £  Aq,  then  ( Rp,Rv )  £  Aq  and, 
if  u  £  B( 0,rctr),  then  Ru  £  B(0,rctr).  Therefore,  using  again  the  linearity  of  the 
maps  (f>,  the  proof  follows.  Regarding  statement  (iv),  the  two  results  follow  from  the 
definition  of  Ad(rpos,  rctr)  and  the  facts  that,  for  all  0  <  n  <  r2,  B(0,n)  C  R(0,r2) 
and  Aq(ti)  C  Ao(r2).  □ 

Next,  we  study  the  set- valued  map  that  associates  to  each  state  in  Ad{rpos,  rctr) 
the  set  of  control  inputs  that  keep  the  state  inside  Ad(rpos,  rc tr)  in  one  step.  We  define 
the  admissible  control  set  Ud(rpos,rcti)  ■  Ad(rpos,rctr)  =1  B(0d,rcti)  by 

Id  (rpos,  rct r)  ■  (p,  u)  —  {ia  £  B(0d,  v ctr )  |  (p  T  v,  v  3“  if)  £  A  (rpos,  rctr)} , 
or,  equivalently, 

Ud{rpos,  rc tr)  •  (p,  v)  =  B(0d,  rctr)  H{w  -  v  |  (p  +  v,  w)  £  Ad(rpos,  rct r)}.  (2.2) 

Lemma  2.2  (Properties  of  the  admissible  control  set).  For  all  (p,v)  £  Ad(rp0s,i"  ctr), 
the  set  Ud(rpos,  rctr)  ■  (p,  v)  is  non-empty,  convex  and  compact.  For  generic  (p,v)  £ 
Ad(r pos,  rctr),  the  setUd{rpos,rctT)  ■  (p,v)  does  not  contain  0d- 

Proof.  The  non-emptiness  of  the  set  Ud(rpos,  rctr)  •  (p,  v)  derives  directly  from  the 
definition  of  Ad(rpos,  rctr).  Clearly,  from  equation  (2.2),  Ud(rpos,rctT)  ■  (p,v)  is  closed 
(it  is  the  intersection  of  two  closed  sets).  It  is  also  bounded  (Ud{rpos,rctI)  ■  ( p,v )  C 
B(0d,rctr)),  hence  it  is  compact.  To  prove  that  it  is  convex,  we  need  to  show  the 
following:  given  (p,v)  £  Ad(rpos,rctr),  if  there  exist  u\  and  m2  in  Ud(rpos,rctI)  ■ 
(p,  v)  such  that  ^(1,  (p,  v),  u\)  and  (f>(  1,  (p,  v),  u2)  belong  to  Ad(rpos,  rctr),  then  u\2  = 
Aui  +  (1  -  A )u2,  A  £  [0, 1],  belongs  to  Ud(rpos,  rc tr)  •  (p,  v),  that  is,  (p,  v),  wi2)  £ 
Ad(rpos  ,  r ctr).  But  this  fact  follows  directly  from  the  linearity  of  <j>  and  the  convexity 
of  Ad(rPos,  r ctr ) ■  This  proves  that  Ud(rpos,  rctr)  •  (p,  v)  is  convex.  The  fact  that  it  does 
not  necessarily  contain  the  origin  can  be  proven  by  contradiction  as  follows.  Consider 
a  (p,v)  £  Ad(rpos,rctI)  such  that  v  0d  and  Ud(rpos,rctI)  ■  (p,v)  contains  0^.  This 
means  that  (jp+v,  v)  also  belongs  to  Ad(rpos,  rctr).  Now,  either  Ud(rpos,  rctr)  •  (p  +  v,  v ) 
does  not  contain  0^,  in  which  case  we  have  proved  the  statement,  or  Ad(rpos ,  rctr)  also 
contains  (p  +  2v,v).  Continuing  along  these  lines,  if  it  were  true  that  Ud(rpos,rc tr)  • 
(p,v)  contains  the  origin  for  all  (p,  v)  £  Ad(rpos,rc tr),  then  one  could  show  that 
(p+tv,  v)  belongs  to  Ad(rpos,  rctr)  for  all  t  £  N.  However,  Ad(rpos,  rctr)  is  bounded  by 
Theorem  2.1.  Hence,  one  can  always  find  a  t*  £  N  such  that  ( p+t*v ,  v )  £  Ad(rpos,  rc tr) 
but  (p  +  (t*  +  l)u,  v )  £  Ad(rpos  ,  r^),  thereby  proving  that  Ud(rpos ,  rctr)  •  (p  +  t*v,  v ) 
does  not  contain  0^.  □ 

2.2.  Computing  admissible  sets.  We  characterize  Ad  for  d  =  1  in  the  follow¬ 
ing  result  and  we  illustrate  the  outcome  in  Figure  2.1. 

Lemma  2.3  (Admissible  set  in  1  dimension).  For  rpos,rc tr  £  R+,  the  following 
holds: 
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(2.3) 


(i)  ^41(t'Posj  rctr)  is  the  polytope  containing  the  points  (p,v)  £  R2  satisfying 


T'pos 

m 


m  —  1  p  rDOS  m  —  1 

— x — rctr  <  V  +  —  <  +  ~^—rctI, 

Z  mm  2 


for  all  m  £  N,  and  p  £  ]-rpos,  rpos]; 
(ii)  If  fh(rp0s,  rctr)  £  N  is  defined  by 


fh{rv os,  rctT) 


(2.4) 


then  A1  =A1m  =  ^~(T.poSjr.ctr),  for  m  >  m(rpos,  rctr). 

Proof.  Regarding  statement  (i),  it  suffices  to  show  that,  for  m  £  N,  -4)„(rPos,  rctr) 
is  the  set  of  points  in  ^4)rt_1(rpos,  rc tr)  that  satisfy  equation  (2.3).  If  we  show  that  this 
property  holds  for  all  m,  then  we  can  use  statement  (i)  of  Theorem  2.1  to  complete 
the  proof.  Consider  the  set  of  equations  (2.1)  for  to  consecutive  time  indices  after  t. 
The  solution  of  the  linear  system  can  be  written  in  terms  of  the  state  at  instant  t  as 


p[t  +  to] 
v[t.  +  m\ 


1 

0 


TO 

1 


P[t\ 

y[t] 


m—  1 


+  E 


i 

0 


(to  —  1  —  r) 

1 


'O' 

1 

where  we  used  the  equality 


'1 

1' 

r 

1  r 

o 

1 

0  1 

r  €  N. 


(2.5) 


It  is  clear  that  the  points  on  the  boundary  of  A\n  have  the  property  that  the  maximum 
control  effort  is  needed  to  enforce  the  constraint.  In  other  words  we  look  for  the  points 
(p[t],  u[£])  £  Aq  with  v[t]  >  0  (the  case  v[t]  <  0  can  be  solved  in  a  similar  way)  such 
that  the  points  p[t  +  to]  <  rcm m  are  reached  by  using  the  maximum  control  effort 
U[t+T]  =  —rctr;  T  S  {0,  ...,TO-  1}. 

Substituting  the  expression  of  the  control  in  (2.5)  we  obtain 


m— 1 

p[t  +  to]  =  p[t\  +  mv[t\  -  rctr  Y(m-1-T), 

r— 0 

v[t  +  m\=  u[t]  -  mr ctr, 


and  using  the  equality  Y^T=o(m  —  1  —  r)  =  1\  we  have 

r  ,  .  .  .  .  TO(TO  —  1) 

P[t  +  m\=  p[t\  +  mv[t\  -  rctr - - - 

v[t  +  m]  =  v[t]  -  mr ctT, 


(2.6) 


In  order  to  belong  to  A the  point  (p[t],v[t\)  must  satisfy  the  constraint  p[t  +  r]  < 
r cmm;  t  £  {1, ,  to},  or  equivalently 


v[t\  < 


P[t] 


r  cmm 


r 


+  rctr 


1) 


T  £  to}. 


Using  the  same  procedure  for  the  points  in  the  half  plane  v[t\  <  0  (in  this  case  the 
control  is  u[t  +  r]  =  rctr,  tG{0,...,to— 1}),  it  turns  out  that  A „  is  equal  to  the  set 
of  all  pairs  (p,  v)  £  A\  satisfying 


P  ^  cmm 

r  r 


t-  1  .  .  P  rcmr 

— — rctr  <  v  < - 1 - 

2  r  r 


5 


r  —  1 


^ctr  5 


T  £  {1,  .  .  .  ,  to}. 


By  using  statement  (i)  of  Theorem  2.1  the  proof  is  complete. 

Regarding  statement  (ii),  let  us  consider  the  case  u[t]  >  0  and  evaluate  the  points 
on  the  boundary  such  that  (p[t  +  m],  v[t  +  m])  =  (Vcmm,  0),  ro  £  N.  These  points  are 
obtained  by  substituting  the  above  value  of  (p[f  +  m],v[t  +  to])  in  (2.6).  The  points 
obtained  are  (p,  v)  such  that 


(to  +  1) 

P  —  7"  cmm  ^  “  T , ctr  5 


TO  €  No- 


It  is  easy  to  see  that  fh(rpos,rc tr),  as  defined  in  equation  (2.4),  is  the  lowest  to  such 

that  p  ^  ?"cmm-  Id 


V 


Fig.  2.1:  The  admissible  set  A1  for  generic  values  of  rpos  and  rc tr 


Remarks  2.4. 

(i)  If  t ctr  >  2rp0s,  then  A1  =  A\,  that  is,  for  sufficiently  large  rctT/rpos,  the 
admissible  set  is  equal  to  the  admissible  set  in  1  time  step. 

(ii)  The  methodology  for  constructing  -41(rpos,  rc tr)  is  related  to  the  procedure  for 

constructing  the  so-called  isochronic  regions  for  discrete  time  optimal  control 
of  double  integrators,  as  outlined  in  [8j.  □ 

Next,  we  introduce  some  definitions  useful  to  provide  an  inner  approximation  of 
Ad  when  d  >  2.  Given  p  €  and  v  £  K.d  \  {0^},  define  py  £  R  and  p±  £  Rd  by 

v 

P  =  -PllFT  +P-L> 

\\v\\ 


where  p±  ■  v  =  0.  For  rpos,  rc tr  £  R+,  define 

Ad (rpos,  rctT)  =  j(p,  v)  £  B(0dl  rpos)  x  Rd  \  v  =  0d  or 

(p||,|M|)£^1(^os-||p±||21rctr)}.  (2.7) 

Lemma  2.5.  Forrpos ,  rctr  £  R+,  A1) (rpos,  rctr)  is  a  compact  subset  ofAd(rpos,  rctr). 
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Proof.  We  begin  by  showing  that  definition  (2.7)  is  equivalent  to 

*^-||  (^posj  ^ctr)  —  ^  *^0  I  ^  —  brf  Or  ^{^UtItGNo  —  [  ^ctr^ctr] 

s.t.  (p,u),{u||T}||^|7)  G  -4o(rpos);  VfGN  o}.  (2.8) 

To  establish  this  equivalence,  we  use  the  definition  of  the  set  A1.  For  v  ^  Od,  we 
rewrite  the  solution  of  the  system  as 

V 

0{t,  (p,  v),  {ur})  =  (j) ||  (t,  (p,  v),  {uT})—  +  </)±{t,  (p,  v),  {uT}), 

IMI 

where  (j)±(t,  (p,v),{uT})  ■  v  =  0  for  all  t  G  No-  It  is  easy  to  see  that,  if  {wT}reN0  = 
{w||r}reN0pj|,  then  0j_(i,  (p,v),  {uT})  =  (p_L,0d)  for  all  t  G  N0.  Therefore, 

V 

(p,  r),K})  =  <£||(£,  (p,u),{uT})||^|7  +  (p_L,  0d). 

Note  that,  if  p  =  py^  +p_l,  then  ||p||  <  rpos  if  and  only  if  py  <  ^Jr%os  -  ||_p_j_ ||2- 
Therefore,  the  property  (j>(t,  (p,  v),  {uy  r^w)  G  ^o(rPos)  is  equivalent  to 

H  (t,  (p,  V),  Hlr^)  e  ^0  (\Jrlos-  \\P±\\2)  , 

and,  in  turn,  definitions  (2.7)  and  (2.8)  are  equivalent.  In  order  to  prove  that 
A^  (rpos,  rc tr)  is  compact,  we  simply  observe  that  it  is  a  closed  subset  of  the  com¬ 
pact  set  -4d(rpos,  rctr)-  □ 

Remark  2.6.  In  what  follows  we  use  our  representation  of  Ad  to  compute  an 
inner  approximation  for  the  convex  set  Ad ,  for  d  >  2.  For  example,  for  fixed  p  G 
R(0^,  rpos),  we  compute  velocity  vectors  v  such  that  (p,v)  G  Ad  by  considering  a 
sample  of  unit-length  vectors  w  G  Rd  and  computing  the  maximum  allowable  velocity 
v  parallel  to  ui  according  to  equation  (2.7).  Furthermore,  we  perform  computations 
by  adopting  inner  polytopic  representations  for  the  various  compact  convex  sets.  □ 

2.3.  The  double-integrator  disk  graph.  Let  us  introduce  some  concepts 
about  state  dependent  graphs  and  some  useful  examples.  For  a  set  X,  let  F(X) 
be  the  collection  of  finite  subsets  of  X\  e.g.,  V  G  F(Rd)  is  a  set  of  points.  For  a  finite 
set  X,  let  G(X)  be  the  set  of  undirected  graphs  whose  vertices  are  elements  of  X, 
i.e.,  whose  vertex  set  belongs  to  F(X).  For  a  set  X,  a  state  dependent  graph  on  X 
is  a  map  Q  :  F(X)  — >  G(X)  that  associates  to  a  finite  subset  V  of  X  an  undirected 
graph  with  vertex  set  V  and  edge  set  £g(V)  where  Eg  :  F(X)  — >  F(X  x  X)  satisfies 
£g{V)  Q  V  x  V.  In  other  words,  what  edges  exist  in  Q{V)  depends  on  the  elements 
of  V  that  constitute  the  nodes. 

The  following  three  examples  of  state  dependent  graphs  play  an  important  role. 
First,  given  rpos  G  R+,  the  disk  graph  t/diskVpos)  is  the  state  dependent  graph  on  Rd 
defined  as  follows:  for  {pi, . . .  ,p„}  C  Md,  the  pair  ( Pi,Pj )  is  an  edge  in  5disk(?”pos)  ■ 
({pi, . . .  ,p„})  if  and  only  if 

|| Pi  -  Pill  <  rpos  •<=>■  Pi  -  Pj  G  B(0d,rpos). 

Second,  given  rpos,  rc tr  G  R+,  the  double-integrator  disk  graph  t/di-diskVposj  rctr)  is  the 
state  dependent  graph  on  R2d  defined  as  follows:  for  {(pi,  ui), . . . ,  (p„,  u„)}  C  R2d, 
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the  pair  ((Pi,Vi),  ( Pj,Vj ))  is  an  edge  if  and  only  if  the  relative  positions  and  velocities 
satisfy 


( Pi  ~  Pj,Vi  -  Vj)  £  Ad(rpos,  rc tr). 

Third,  it  is  convenient  to  define  the  disk  graph  also  as  a  state  dependent  graph  on 
R2d  by  stating  that  ((pi,Vi),  ( pj,Vj ))  is  an  edge  if  and  only  if  ( pi,pj )  is  an  edge  of  the 
disk  graph  on  Rd.  We  illustrate  the  first  two  graphs  in  Figure  2.2. 


Fig.  2.2:  The  disk  graph  and  the  double-integrator  disk  graph  in  R2  for  20  agents  with 
random  positions  and  velocities. 


Remark  2.7.  As  is  well  known,  the  disk  graph  is  invariant  under  rigid  transfor¬ 
mations  and  reflections.  Loosely  speaking,  the  double  integrator  disk  graph  is  invariant 
under  the  following  class  of  transformations:  position  and  velocities  of  the  agents  may 
be  expressed  with  respect  to  any  rotated  and  translated  frame  that  is  moving  at  constant 
linear  velocity.  These  transformations  are  related  to  the  classic  Galilean  transforma¬ 
tions  in  geometric  mechanics.  □ 

3.  Connectivity  constraints  among  second-order  agents.  In  this  section 
we  state  the  model,  the  notion  of  connectivity,  and  a  sufficient  condition  that  guar¬ 
antees  connectivity  can  be  preserved. 

3.1.  Networks  of  robotic  agents  with  second-order  dynamics  and  the 
connectivity  maintenance  problem.  We  begin  by  introducing  the  notion  of  net¬ 
work  of  robotic  agents  with  second-order  dynamics  in  Rd.  Let  n  be  the  number  of 
agents.  Each  agent  has  the  following  computation,  motion  control,  and  communica¬ 
tion  capabilities.  For  i  £  {l,...,n},  the  *th  agent  has  a  processor  with  the  ability 
of  allocating  continuous  and  discrete  states  and  performing  operations  on  them.  The 
*th  agent  occupies  a  location  p,  £  Md,  moves  with  velocity  Vi  £  Rd,  according  to  the 
discrete-time  double  integrator  dynamics  in  (2.1),  i.e. , 

Pi[t  +  1]  =  Pi[t\  +  Vi[t\, 

Vi[t  +  1]  =  Vi[t\  +  Ui[t ], 

where  the  norm  of  all  controls  Ui[t\,  i  £  {1,  ...,n},  t  £  No,  is  upper-bounded  by 
r ctr  £  R+.  The  communication  model  is  the  following.  The  processor  of  each  agent 
has  access  to  the  agent  location  and  velocity.  Each  agent  can  transmit  information 


to  other  agents  within  a  distance  rcmm  £  R+.  We  remark  that  the  control  bound  rctr 
and  the  communication  radius  rcmm  are  the  same  for  all  agents. 

Remarks  3.1. 

(i)  Our  network  model  assumes  synchronous  execution,  although  it  would  be  im¬ 
portant  to  consider  more  general  asynchronous  networks. 

(ii)  We  will  not  address  in  this  paper  the  correctness  of  our  algorithms  in  the 
presence  of  measurement  errors  or  communication  quantization.  □ 

We  now  state  the  control  design  problem  of  interest. 

Problem  3.2  (Connectivity  Maintenance).  Choose  a  state  dependent  graph 
^target  on  R2d  and  design  (state  dependent)  control  constraints  sets  with  the  follow¬ 
ing  property:  if  each  agent’s  control  takes  values  in  the  control  constraint  set,  then 
the  agents  move  in  such  a  way  that  the  number  of  connected  components  of  ^target 
(evaluated  at  the  agents’  states)  does  not  increase  with  time.  □ 

This  objective  is  to  be  achieved  with  the  limited  information  available  through 
message  exchanges  between  agents.  This  problem  was  originally  stated  and  solved  for 
first-order  agents  in  [2], 

3.2.  A  known  result  for  agents  with  first-order  dynamics.  In  [2],  a  con¬ 
nectivity  constraint  was  developed  for  a  set  of  agents  modeled  by  first-order  discrete¬ 
time  dynamics: 


Pi[t+1]  =Pi[t]  +Ui[t\. 

Here  the  graph  whose  connectivity  is  of  interest,  is  the  disk  graph  f/disk(^cmm)  over 
the  vertices  {pi[f], . . .  ,pn[t\}.  Network  connectivity  is  maintained  by  restricting  the 
allowable  motion  of  each  agent.  In  particular,  it  suffices  to  restrict  the  motion  of  each 
agent  as  follows.  If  agents  i  and  j  are  neighbors  in  the  rcmm-disk  graph  t/disk(rCmm)  at 
time  t,  then  their  positions  at  time  t+  1  are  required  to  belong  to  £?(- iMTElM  ^  Igmm  y 
In  other  words,  connectivity  between  i  and  j  is  maintained  if 

The  constraint  is  illustrated  in  Figure  3.1. 


Fig.  3.1:  Starting  from  pi  and  Pj,  the  agents  are  restricted  to  move  inside  the  disk  centered 
at  with  radius  T’c™m . 
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Note  that  this  constraint  takes  into  account  only  the  positions  of  the  agents; 
this  fact  can  be  attributed  to  the  first-order  dynamics  of  the  agents.  We  wish  to 
construct  a  similar  constraint  for  agents  with  second  order  dynamics.  It  is  reasonable 
to  expect  that  this  new  constraint  will  depend  on  positions  as  well  as  velocities  of  the 
neighboring  agents. 

3.3.  An  appropriate  graph  for  the  connectivity  maintenance  problem 
for  agents  with  second-order  dynamics.  We  begin  working  on  the  stated  problem 
with  a  negative  result  regarding  two  candidate  target  graphs. 

Lemma  3.3  (Unsuitable  graphs).  Consider  a  network  of  n  agents  with  double 
integrator  dynamics  (3.1)  in  S.d.  Let  rcmm  be  the  communication  range  and  let  rc tr 
be  the  control  bound.  Let  (/target  be  either  <?disk(rCmm)  onM.2d  or  Qdi_disk(rcmin,2rctr). 

There  exist  states  {(pi,  Ui)}iS{1  ,...,n}  such  that 

(i)  the  graph  Q target  at  {(ft, i’i)}ie{i,...,n}  connected,  and 

(ii)  for  all  {wi}*e{i,...,n}  CB(0d,rctr),  the  graph  Q target  at  {{pi+Vi,  Ui+u*)}fe{i, 
is  disconnected. 

Proof.  The  proof  of  the  statement  for  (/target  =  G disk(i'cmm)  is  straightforward. 
Consider  two  agents  whose  relative  position  and  velocity  belong  to  Ad\Ad.  Then, 
after  one  time  step,  the  two  agents  will  not  be  connected  in  (/disk(r'cmm)  no  matter 
what  their  controls  are.  Next,  consider  the  case  (/target  =  (?di-disk(r,cmm)  2rctr).  For 
d  =  1,  let  v  be  the  maximal  velocity  in  A1(rcmm,  2rctr)  at  p  =  0,  that  is,  v  = 
min{rcmm/m  +  (m  —  l)rctr  |  m  £  N}.  Take  three  agents  with  positions  pi  =  P2  = 

Ps  =  0  and  velocities  v\  =  —v,  V2  =  0,  and  V3  =  v.  At  this  configuration,  the  graph 
I/di-disk (r'cmm,  2rctr)  contains  two  edges:  between  agent  1  and  2  and  between  agent  2 
and  3.  Connectivity  is  preserved  after  one  time  step  if  agent  2  remains  connected  to 
both  agents  1  and  3  after  one  time  step.  However,  to  remain  connected  with  agent 
1,  its  control  U2  must  be  equal  to  — rc tr  and,  analogously,  to  remain  connected  with 
agent  3,  its  control  U2  must  be  equal  to  +rctr-  Clearly  this  is  impossible.  □ 

Remarks  3.4. 

(i)  The  result  in  Lemma  3.3  on  the  double  integrator  graph  has  the  following 
interpretation.  Assume  that  agent  i  has  two  neighbors  j  and  k  in  the  graph 
I/di-disk (rCmm,  rctr).  By  definition  of  the  neighboring  law  for  this  graph,  we 
know  that  there  exists  bounded  controls  fori  and  j  to  maintain  the  (( pi,Vi ),  ( Pj,Vj )) 
link  and  that  there  exists  bounded  controls  for  i  and  k  to  maintain  the  (( pi ,  Vi),  (pk,  Vk )) 
link.  The  lemma  states  that,  for  some  states  of  the  agents  i,  j ,  and  k,  there 
might  not  exist  controls  that  maintain  both  links  simultaneously. 

(ii)  In  other  words,  Lemma  3.3  shows  how  the  disk  graph  (/disk(rCmm)  and  the 

double  integrator  disk  graph  (/di-disk(rCmm,  2rctr)  are  not  appropriate  choices 
for  the  connectivity  maintenance  problem.  □ 

The  following  theorem  suggests  that  an  appropriate  scaling  of  the  control  bound 
is  helpful  in  identifying  a  suitable  state  dependent  graph  for  Problem  3.2. 

Theorem  3.5  (A  scaled  double-integrator  disk  graph  is  suitable).  Consider  a 
network  of  n  agents  with  double  integrator  dynamics  (3.1)  in  Rd.  Let  rcmm  be  the 
communication  range  and  let  rc tr  be  the  control  bound.  For  k  £  {1, . . . ,  n  —  1},  define 


Assume  that  k  £  {l,...,n— 1}  and  the  state  {(Pi,^i)}»e{i,...,n}  together  have  the  prop¬ 
erty  that  the  graph  </di-disk  (rCmm ,  v(k)rctT)  at  {(p^  v»)},e{i, contains  a  spanning 
tree  T  with  diameter  at  most  k.  Then  there  exists  C  f?(0d,  rctr)  such 
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that  if  (( Pi ,  vf),  ( Pj,Vj ))  is  an  edge  of  T,  then  (( pi  +  v^,  Vi  +  uf),  ( Pj  +  Vj,  Vj  +  Uj))  is 
an  edge  of  <?di-disk(rcmm,  v(k)rctI)  at  {{jpi  + vuVi  +  • 

These  results  are  based  upon  Shostak’s  Theory  for  systems  of  inequalities,  as 
exposed  in  [9].  We  provide  the  proof  in  Appendix  B.  The  following  results  are 
immediate  consequences  of  this  theorem. 

Corollary  3.6  (Simple  sufficient  condition).  With  the  same  notation  in  Theo¬ 
rem  3.5,  define  v min  =  \ )v^-  Assume  that  the  state  {( pi ,  ^i)}ie{i,...,n}  has  the  prop¬ 
erty  that  the  graph  Q di-disk (rcmm,  z'mini’ctr)  is  connected  at  {(pi,  relief i,. Then 

(i)  there  exists  {u*}ie{i,...,n}  Q  B(0d,  rc tr),  such  that  the  graph  <5di-disk(rCmm,  ^minrctr) 

is  also  connected  at  {( pi  +Vi,Vi  +  and 

(ii)  if  T  is  a  spanning  tree  of  gdi-disk^m™,  I'minTYt.r)  at  {(p*,t)j)}ie {i, then 
there  exists  {wi}ie(i....,n}  C  B(0d,  rc tr),  such  that,  for  all  edges  ((pi,  vf),  ( pj ,  Vj)) 

ofT,  it  holds  that  (( Pi+Vj ,  Vi+ut),  (pj+Vj,Vj+Uj))  is  an  edge  ofGdl.disk(rclnin,  uminrctr) 
at  {( Pi  +  vit  Vi  +u»)}ie{i,...,n}- 

Remark  3.7  (Scaling  of  nmm  with  n).  The  condition  vmin  =  ^  2 — jy  implies 
that  according  to  the  sufficient  conditions  in  Corollary  3.6,  as  the  number  of  agents 
grows,  the  velocities  of  the  agents  must  be  closer  and  closer  in  order  for  the  agents  to 
be  able  to  remain  connected. 

7/<?di-disk(rCmm,K&)rctr)  at  {i,...,n}  not  connected  for  some  k,  then 

Theorem  3.5  applies  to  its  connected  components.  In  what  follows  we  fix  k  and  without 
loss  of  generality  assume  the  graph  t?di-disk(cCmm,  v{k)rctT)  at  {(pi,  ^*)}»e{i,...,n}  to  be 
connected.  □ 

Remark  3.8  (Distributed  computation  of  connectivity  and  of  spanning  trees). 

Each  agent  can  compute  its  neighbors  in  the  graph  f/di-disk(^cmm,  v(k)rctT)  just  by 
communicating  with  its  neighbors  in  f?disk(rcmm)  and  exchanging  with  them  position 
and  velocity  information.  Alternatively,  this  computation  may  also  be  performed  if 
each  agent  may  sense  relative  position  and  velocity  with  all  other  agents  at  a  distance 
no  larger  than  rcmm. 

It  is  possible  to  compute  spanning  trees  in  networks  via  standard  depth-first  search 
distributed  algorithms.  It  is  also  possible  [10]  to  distributively  compute  a  minimum 
diameter  spanning  tree  in  a  network.  □ 

3.4.  The  control  constraint  set  and  its  polytopic  representation.  We 

now  concentrate  on  two  agents  with  indices  i  and  j .  For  t  £  No,  we  define  the 
relative  position,  velocity  and  control  by  Pij[t\  =  Pi[t ]  —  Pj[t],  Vij[t \  =  Vi\t]  —  Vj[t\  and 
Uij  \t\  =  Ui  [t]  —  Uj  [t] ,  respectively.  It  is  easy  to  see  that 

Pij  [t  T  1]  Pij  [t]  T  Uij  [t] , 

V,,,  \t  T  1]  —  Vjj  [tj  T  Uij  [/.  | . 

Assume  that  agents  i,j  are  connected  in  f?di-disk (’’cmm ,  v(k)rctI)  at  time  t.  By  defini¬ 
tion,  this  means  that  the  relative  state  ipij[t],Vij[t])  belongs  to  Ad(rcmm,v(k)rc tr).  If 
this  connection  is  to  be  maintained  at  time  t  +  1,  then  the  relative  control  at  time  t 
must  satisfy 

Ui  [t]  Vj  7]  £  II  (r cmm,  v(k)rctT)  •  fpij  \t] ,  Vij  [f] ) .  ( 3 ■  2 ) 

Also,  implicit  are  the  following  bounds  on  individual  control  inputs  Ui[t\  and  Uj[t\: 

Ui[t\  G  B(Od,rctT),  Uj[t\  £  B(Od,rctr).  (3.3) 


it 


This  discussion  motivates  the  following  definition. 

Definition  3.9.  Given  rcmm,  rctr,  iz(/c)  G  R+  and  given  a  set  E  of  edges  in 
Sdi-disk^cmm,  v(k)rctr)  at  { (p; ,  ^i) }ie{  1,. the  control  constraint  set  is  defined  by 

udE{  ^  cmm  i  rcti,v{k))  ■  ({Pi,Ui}»e{i,...,n}) 

=  {(ui,...,u„)  G  B(OdlrctI)n  I  V((pi,t)i),(pi,t;j))  £  E, 

Ui  -  Uj  G  Ud(r r.mm,  v{k)rctT)  •  ( Pi  -  Pj,Vi  -Vj)}. 


In  other  words,  the  control  constraint  set  for  an  edge  set  E  is  the  set  of  controls 
for  each  agent  with  the  property  that  all  edges  in  E  will  be  maintained  in  one  time 
step. 

Remark  3.10.  We  can  now  interpret  the  results  in  Theorem  3.5  as  follows. 

(i)  To  maintain  connectivity  between  any  pair  of  connected  agents,  we  should  si¬ 
multaneously  handle  constraints  corresponding  to  all  edges  o/ 1/di-disk  (fcmm,  v(k)rc tr). 
This  might  render  the  control  constraint  set  empty. 

(ii)  However,  if  we  only  consider  constraints  corresponding  to  edges  belonging  to 

a  spanning  tree  T  o/5di-disk(fCmm,  v(k)rctT),  then  the  setUE(rcm m,  v(k)rctI)  ■ 
{{Pijvi}ie{i,...,n})  is  guaranteed  to  be  nonempty.  □ 

Let  us  now  provide  a  concrete  representation  of  the  control  constraint  set.  Given 
a  pair  i,j  of  connected  agents,  the  admissible  control  set  ldd(rcmm ,  v(k)rc tr)  •  ( Pij,Vij ) 
is  convex  and  compact  (Lemma  2.2).  Hence,  we  can  fit  a  polytope  with  Npo\y  sides 
inside  it.  This  approximating  polytope  leads  to  the  following  tighter  version  of  the 
constraint  in  (3.2): 

{C3)T(ui  -  Uj)  <  wl,  rj  G  {1, ... ,  iVp0iy},  (3.4) 

for  some  appropriate  vector  G  Rd  and  scalar  wrk  G  R.  Similarly,  one  can  compute 
an  inner  polytopic  approximation  of  the  closed  ball  B(0d,  rc tr)  and  write  the  following 
linear  vector  inequalities: 

{Cvig)TUi<wvie,  r]  G  {1, . . . ,  fVpoiy},  (3.5) 

where  the  symbol  9  has  the  interpretation  of  a  fictional  agent.  In  this  way,  we  have 
cast  the  original  problem  of  finding  a  set  of  feasible  control  inputs  into  a  satisfiability 
problem  for  a  set  of  linear  inequalities. 

Remark  3.11.  Rather  than  a  network-wide  control  constraint  set,  one  might 
like  to  obtain  decoupled  constraint  sets  for  each  individual  agent.  However,  (1)  it 
is  not  clear  how  to  design  a  distributed  algorithm  to  perform  this  computation,  (2) 
such  an  algorithm  will  likely  have  large  communication  requirements,  and  (3)  such 
a  calculation  might  lead  to  a  very  conservative  estimate  for  the  decoupled  control 
constraint  sets.  Therefore,  rather  than  explicitly  decoupling  the  control  constraint 
sets,  we  next  focus  on  a  distributed  algorithm  to  search  the  control  constraint  set  for 
feasible  controls  that  are  optimal  according  to  some  criterion.  □ 

4.  Distributed  computation  of  optimal  controls.  In  this  section  we  formu¬ 
late  and  solve  the  following  optimization  problem:  given  an  array  of  desired  control 
inputs  Udes  =  (wdes.i,  ■  •  • ,  i*des,n)T  G  (Rd)n,  find,  via  local  computation,  the  array 
U  =  (ui, . . .  ,un)  belonging  to  the  control  constraint  set,  that  is  closest  to  the  de¬ 
sired  array  Udes ■  To  formulate  this  problem  precisely,  we  need  some  additional  no¬ 
tations.  Let  £  be  a  set  of  edges  in  the  undirected  graph  Udi-disk^cmm,  v(k)rct,T)  at 
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{(.Piivi)}ie{ i . n} •  To  deal  with  the  linear  inequalities  of  the  form  (3.4)  and  (3.5) 

associated  to  each  edge  of  E ,  we  introduce  an  appropriate  multigraph.  A  multi¬ 
graph  (or  multiple  edge  graph)  is,  roughly  speaking,  a  graph  with  multiple  edges 
between  the  same  vertices.  More  formally,  a  multigraph  is  a  pair  (T4mit,  -Emuit), 
where  Knuit  is  the  vertex  set  and  the  edge  set  Emu\t  contains  numbered  edges  of 
the  form  ( i,j,r /),  for  i,j  £  V  and  rj  £  N,  and  where  l?muit  has  the  property  that 
if  (■ i,j,r) )  £  -Emuit  and  rj  >  1,  then  also  ( i,j,rj  —  1)  £  -Emuit-  In  what  follows, 
we  let  Gmuit  denote  the  multigraph  with  vertex  set  {l,...,n}  and  with  edge  set 
-Emuit  =  {(i,j,v)  G  {l,...,n}2  x  {l,...,Apoly}  |  £  E,  i  >  j}.  Note 

that  to  each  element  (i,  j,  rj)  £  Emu\t  is  associated  the  inequality  {C3)T  (ui  —  Uj)  <  iu?-. 

We  are  now  ready  to  formally  state  the  optimization  problem  at  hand  in  the  form  of 
the  following  quadratic  programming  problem: 

1  " 

minimize  -  ^  1 1  m  -  udes,i  1 1 2 , 

1=1  (4.1) 

subj.  to  {C^)T (ui  -  Uj)  <  w^j ,  for  (i,  j,rj)  £  EmuU, 

{Cjg)TUi  <  wvid,  for  i  £  {1, . . . ,  n},  rj  £  {1, . . . ,  7Vpoly}. 

Here,  somehow  arbitrarily,  we  have  adopted  the  2-norm  to  define  the  cost  function. 

Remark  4.1  (Feasibility).  If  E  is  a  spanning  tree  o/Udi-disk^cmm,  vrctfi)  at  a  con¬ 
nected  configuration  {( pi ,  Wi)}*e{i,. ..,n}>  then  the  control  constraint  setU^(rcmm,  rc tr,  v{k))- 
{{Pi,  ui}ie{i,...,rs})  Is  guaranteed  to  be  non-empty  by  Theorem  3.5.  In  turn,  this  implies 
that  the  optimization  problem  (4.1)  is  feasible.  □ 

4.1.  Solution  via  duality:  the  projected  Jacobi  method.  The  problem  (4.1) 
can  be  written  in  a  compact  form  as: 


minimize  -\\U  -  Udes\\2, 
subj.  to  A  w , 

for  appropriately  defined  matrix  Rmuit  and  vector  w.  A  dual  “projected  Jacobi 
method”  algorithm  for  the  solution  of  this  standard  quadratic  program  is  described  in 
Appendix  A.  According  to  this  algorithm,  let  A*  be  the  value  of  Lagrange  multipliers 
at  optimality.  Then  the  global  minimum  for  U  is  achieved  at 

U*  =  Udes-Bmult\*.  (4.2) 

The  projected  Jacobi  iteration  for  each  component  of  A  is  given  by 


AQ(t+  1)  =  max  jo,  Xa{t)  -  — T ^ - r — ({w  -  BjjultUdes) 

1  v-^mult  -^mult )  ota.  x 


-^poly  (c- l~Tl) 

(^mult^mult)c 

/3=1 


,  (4.3) 


where  a  £  {1, ...,  Npo\y(e  +  n)}  and  r  is  the  step  size  parameter.  We  can  select 
r  =  n  i  \e+n)  t°  guarantee  convergence. 
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4.2.  A  distributed  implementation  of  the  dual  algorithm.  Because  of  the 
particular  structure  of  the  matrix  the  iterations  (4.3)  can  be  implemented 

in  a  distributed  way  over  the  original  graph  G.  To  highlight  the  distributed  structure 
of  the  iteration  we  denote  the  components  of  A  by  referring  to  the  nodes  that  they 
share  and  the  inequality  they  are  related  to.  In  particular  for  each  edge  in  Gmuit,  the 
corresponding  Lagrange  multiplier  will  be  denoted  as  AT  if  the  edge  goes  from  node  i  to 
node  j,i  >  j,  and  the  edge  is  associated  to  the  inequality  constraint  C'T  (ui—Uj)  <  w T . 
This  makes  up  the  first  iVpoiye  entries  of  the  vector  A.  To  be  consistent  with  this 
notation,  the  next  Npoiyn  entries  will  be  denoted  A}e, . . . ,  A^poly, . . . ,  . . . ,  A ^oly. 

Additionally,  define  Af(i)  =  {j  £  {l,...,n}  |  {(pi,  Vi),  (pj,  Vj)}  £  E}  U  {0}.  The 
symbol  9  has  the  interpretation  of  a  fictional  node. 

Defining  AT  :=  AT  and  C'T  :=  —  C'T  for  i  <  j,  we  can  write  equations  (4.2)  and 
(4.3)  in  components  as  follows.  Equation  (4.2)  reads,  for  i  £  {1, . . . ,  n }, 

-Wpoly 

U*=UdeB,i-  E  E  CikXik- 

kGAf(i)  »?=1 

One  can  easily  work  an  explicit  expression  for  matrix  product  i?^uitBmuit  in  (4-3). 
Then,  equation  (4.3)  reads,  for  (i,j,  77)  £  Eimuit, 


Xlj  (t  +  1)=  max  1 0,  AT  (; t )  -  2^cvycv  ' 

-^poly  -^poly 

£  £  ((cj)'«)  +  £  £  ((qfcjAj,) 

keM(i)  a— 1  fceAA(j)  <j= 1 

T  wij  —  (GT)  (rides, z  —  rides, j) 

together  with,  for  i  £  {1, . . . ,  n}7  77  £  {1, ... ,  iVpoiy}, 
xid(t+1)  =  max  jo,  A^(t) 

-ATpoly 

~  lr/]Trn(  E  E((^)T^)  +  ^-(^)Ves,z)}. 

M(i)  <7=1 

We  distribute  the  task  of  running  iterations  for  these  Apoiy(e  +  n)  Lagrange 
multipliers  among  the  n  agents  as  follows:  an  agent  i  carries  out  the  updates  for 
all  quantities  \vie  and  all  AT  for  which  i  >  j.  By  means  of  this  partition  and  by  means 
of  iterated  one-hop  communication  among  agents,  it  is  possible  to  compute  the  global 
solution  for  the  optimization  problem  (4.1)  in  a  distributed  fashion  over  the  double 
integrator  disk  graph. 

5.  Simulations.  To  illustrate  our  analysis  we  focus  on  the  following  scenario. 
For  the  two  dimensional  setting,  i.e.,  for  d  =  2,  we  assume  that  there  are  n  =  5  agents 
with  (randomly  chosen)  initial  condition  and  such  that  they  are  connected  according 
to  I/di-disk-  The  bound  for  the  control  input  is  rctr  =  2  and  the  communication  radius 
is  rcmm  ==  10. 
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We  assigned  to  one  of  the  agents  a  derivative  feedback  control  ux[p,  u]  =  ( vx  —  2), 
uy[p,v]  =  ( Vy  —  5)  as  desired  input.  For  the  other  agents  the  desired  input  is  set 
to  zero.  We  show  the  agent  trajectories  in  Figure  5.1a,  the  velocities  of  the  agents 
with  respect  to  time  in  Figure  5.1b,  and  the  distances  between  agents  which  are 
neighbors  in  the  spanning  tree  in  Figure  5.1c.  Notice  that  the  agents  move  with 
approximately  identical  velocity  reaching  a  configuration  in  which  all  of  them  are 
at  the  limit  distance  rcmm  =  10.  The  interesting  aspect  of  this  simulation  is  that 
the  maintenance  of  connectivity  leads  to  the  accomplishment  of  apparently  unrelated 
coordination  tasks  as  velocity  alignment  and  cohesiveness.  This  numerical  result 
illustrate  how  our  connectivity  maintenance  approach  might  indeed  be  a  starting 
point  for  novel  investigations  into  the  problem  of  flocking  with  connectivity. 


(a)  Positions  (b)  Velocities  ( vx  and  vy)  (c)  Inter-agent  distances 

Fig.  5.1:  Velocity  alignment  and  cohesiveness  for  5  agents  in  the  plane  (d  =  2) 


6.  Conclusion.  We  provide  some  distributed  algorithms  to  enforce  connectiv¬ 
ity  among  networks  of  agents  with  double-integrator  dynamics.  Future  directions  of 
research  include  (i)  evaluating  the  communication  complexity  of  the  proposed  dis¬ 
tributed  dual  algorithm  and  possibly  designing  faster  ones,  (ii)  studying  the  rela¬ 
tionship  between  the  connectivity  maintenance  problem  and  the  platooning  and  mesh 
stability  problem,  and  (iii)  investigating  the  flocking  phenomenon  and  designing  flock¬ 
ing  algorithms  which  do  not  rely  on  a  blanket  assumption  of  connectivity. 
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Appendix  A.  Projected  Jacobi  method.  We  briefly  review  here  a  paral¬ 
lel  algorithm  for  the  solution  of  a  quadratic  optimization  problem.  The  technique 
is  known  as  the  projected  Jacobi  method  in  the  literature  on  network  flow  control 
problems  ([11],  Section  3.4). 

Consider  the  quadratic  programming  problem 


minimize  —xTQx  —  bTx, 
subj.  to  Ax  A  c, 


where  Q  is  a  given  nxn  symmetric  positive  definite  matrix,  A  is  a  given  m x  n  matrix, 
and  b  €  R”  and  c  €  Rm  are  given  vectors.  The  dual  problem  is 


minimize  —yTFy  +  sTy, 
subj.  to  y  >z  0, 


for  F  =  AQ~1At  and  s  =  c  —  AQ~1b.  If  y*  solves  the  dual  problem,  then  x*  = 
Q~x(b  —  ATy*)  solves  the  primal  problem. 

For  a  step  size  parameter  r  >  0  and  for  j  £  {l,...,n},  the  projected  Jacobi 
iteration,  when  the  jth  coordinate  is  updated,  has  the  form 


m 

Vj(t  +  1)  =  max  jo,  yj (t)  -  j Sj  +  fjkVk{t ))  j, 


k=  1 


(A.l) 


where  fjk  is  the  j,  fcth  element  of  the  matrix  F.  As  discussed  in  [11],  this  algorithm 
converges  to  the  global  solution  of  the  dual  problem  if  the  step  size  r  is  chosen 
sufficiently  small;  in  particular,  convergence  is  guaranteed  for  r  =  1/m. 

Appendix  B.  Appendix  on  Shostak’s  test.  This  section  provides  a  proof  for 
Theorem  3.5.  The  proof  amounts  to  showing  that  if  E  is  the  edge  set  of  a  spanning 
tree  T  in  t/di-disk(?"cmm,  v(k)r ctr)  at  {(p»,  Uj)}je{i, then  the  control  constraint  set 
WfitrcmniJctr,#))  ■  {{Pi,Vi}ie{ i,...,n})  is  non-empty.  We  first  consider  a  polytopic 
approximation  of  constraints  (3.2)  and  (3.3).  Among  all  possible  choices,  we  use 
the  conservative  orthotope  approximation  that  allows  us  to  decouple  the  constraints 
into  d  independent  sets  of  linear  inequalities  (one  for  each  dimension).  Then  we 
use  Shostak’s  theory  to  obtain  sufficient  conditions  for  the  feasibility  of  these  linear 
inequalities.  For  brevity,  we  drop  the  dependence  of  the  quantities  on  t  and  we  assume 
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that  the  variables  it,;  are  scalars,  for  all  i  £  {1, . . . ,  n}  and  t  >  0.  The  resulting  sets  of 
linear  inequalities  for  one  particular  dimension  are 

Slj  <Ui-  Uj  <  6^,  and  -  <  ut  <  ^|.  (B.l) 

where  —  v(k)rcxT  <  8\  j  <  5™j  <  ^(fc)rctr,  for  all  i,j  £  {1, . . . ,  n}  and  i  ^  j. 

B.l.  Shostak  Theory.  In  this  section  we  present  Shostak’s  theory  for  feasibility 
of  linear  inequalities  involving  at  most  two  variables,  similar  to  the  ones  in  (B.l). 
These  ideas  will  then  be  used  to  prove  Theorem  3.5.  The  notations  used  in  [9]  adapted 
to  our  case  are  presented  next.  Let  uo  be  an  auxiliary  zero  variable  that  always  occurs 
with  zero  coefficient  -  the  only  variable  that  can  do  this.  Without  loss  of  generality, 
we  can  thus  assume  that  all  the  inequalities  in  £  contain  two  variables.  As  a  result 
of  this,  the  inequalities  in  (B.l)  can  be  succinctly  written  as 

Ui  —  Uj  <  Sitj ,  Vi,  j  £  {0, . . .  ,n},  (B.2) 

where  for  all  i,j  £  {l,...,n},  i  ^  j,—u(k)rc tr  <  <5,;.,  <  v(k)rc tr  and  for  all  i  £ 
{1, . . . ,  n},  Si:o  =  8o,i  =  Also  implicit  in  this  formulation  is  the  relation  that 

8ij  +  8jti  >  0  for  all  i,j  £  {0, . . . ,  n}  and  i  ^  j. 

Let  £  denote  the  system  of  inequalities  in  (B.2).  We  construct  the  graph  G(£) 
with  n  +  1  vertices  and  2(2n  —  1)  edges  as  follows:  (a)  For  each  variable  iq  occurring 
in  £,  add  a  vertex  i  to  G(£).  (b)  For  each  inequality  of  the  form  ai^Ui  +  bijUj  <  Sij 
in  £,  add  an  undirected  edge  between  i  and  j  to  G(£),  and  label  the  edge  with 
the  inequality  (see  Figure  B.l).  It  is  easy  to  see  the  following  relation  between  the 
spanning  tree  T  in  I/di-disk^cmm,  v(k)rctI)  at  {(p*,  'Ci)}ie{i,...,n}  that  is  used  to  derive 
the  constraints  in  the  inequalities  (B.2)  and  the  graph  G(£):  (a)  The  vertex  set  of 
G(£)  is  the  union  of  the  vertex  set  of  T  and  the  auxiliary  vertex  0  (b)  For  every  edge 
{i,j}  in  T,  there  are  two  edges  between  the  vertices  i  and  j  in  G(£)  (c)  Additionally, 
G(£)  contains  two  edges  between  0  and  every  other  vertex  i,  for  all  i  £  {1, . . . ,  n}. 


Fig.  B.l:  Snippet  of  the  graph  G(£)  for  the  system  of  inequalities  in  (B.2) 

To  every  edge  represented  by  the  inequality  of  the  form  at^Ui  +  bijUj  <  5itj,  we 
associate  a  triple  (aij,bij,5itj).  Note  that  (bij,aij,5ij)  is  also  a  triple  associated 
with  the  same  edge.  Without  loss  of  generality,  consider  a  path  of  G(£)  determined 
by  the  vertices  {1,2,...,/  +  1}  and  the  edges  ei,2,  e2,3, . . . ,  ej,j+i  between  them.  A 
triple  sequence,  P,  associated  with  the  path  is  defined  as 

(ai,2,  &1.2,  ^1,2),  (a 2,3>  ^2,3;  ^2,3),  •  •  •  j  («2,Z+ 1,  &2,Z+1,  <^,2+l), 
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where,  for  1  <  i  <  l,  a^i+iUi  +  bi  i+iUj  <  8i,i+\  is  the  inequality  associated  with  the 
edge  ei>l+i .  If  cq+ 1^+2  and  fe,,j+i  have  opposite  signs  for  1  <  i  <  l,  then  P  is  called 
admissible. 

Define  ( ap,bp,5p ),  the  residue  of  P,  as 

( ap ,  bp ,  (5p)  =  (01,2,  61,2,  ^1,2)  0  (012,3,  &2,3,  <^2,3)  0  •  •  ■  ©  {ai,i+i,biti+i,  5iti+i) , 
where  0  is  the  associativity  binary  operator  defined  on  triples  by 

(a,  b,  S)  0  (a7,  b' ,  (5'}  =  (naa! ,  —nbb',  n(5a'  —  5'b )), 

where  n  =  a'/\a'  |. 

Intuitively,  the  operator  ©  takes  two  inequalities  and  derives  a  new  inequality  by 
eliminating  a  common  variable;  e.g.,  ax+by  <  S  and  a'y+b'z  <  S'  imply  —aa'x+bb'z  < 

—  (5a'  —  5'b)  if  a  <  0  and  b  >  0.  Note  that  the  signs  of  ap  and  011,2  agree,  as  do  the 
signs  of  bp  and  61,2. 

A  path  is  called  a  loop  if  the  initial  and  final  vertices  are  identical.  (A  loop  is  not 
uniquely  specified  unless  its  initial  vertex  is  given.)  If  all  the  intermediate  vertices  of 
a  path  are  distinct,  the  path  is  simple.  An  admissible  triple  sequence  P  associated 
with  a  loop  with  initial  vertex  x  is  infeasible  if  its  residue  satisfies  ap  +  bp  =  0  and 
dp  <  0.  A  loop  which  contains  an  infeasible  triple  sequence  is  called  an  infeasible 
loop.  Thus  if  G(C)  has  an  infeasible  loop,  the  system  of  inequalities  C  is  unsatisfiable. 
However,  the  converse  is  not  true  in  general.  Next,  we  show  how  to  extend  C  to  an 
equivalent  system  C!  such  that  G(C)  has  an  infeasible  simple  loop  if  and  only  if  C  is 
unsatisfiable. 

For  each  vertex  i  of  G(C)  and  for  each  admissible  triple  sequence  P  with  ap+bp  ^ 

0  associated  with  a  simple  loop  of  G(C)  and  initial  vertex  i,  add  a  new  inequality 
(ap  +  bp)ui  <  5p  to  C.  This  new  system  C  is  referred  to  as  the  Shostak  extension 
of  C.  We  now  state  the  necessary  and  sufficient  condition  on  the  extended  system  of 
inequalities  C  for  the  satisfiability  of  the  original  system  C. 

Theorem  B.l  (Shostak’s  Theorem  [9]).  Let  C  be  the  Shostak  extension  of  C. 

The  system  of  inequalities  C  is  satisfiable  if  and  only  if  G(C')  contains  no  infeasible 
simple  loop. 

B.2.  Satisfiability  test.  In  this  section  we  use  the  Shostak  criterion  to  derive 
conditions  for  the  satisfiability  of  the  inequalities  in  (B.2). 

Lemma  B.2.  Let  C  be  the  system  of  inequalities  of  the  form  (B.2)  obtained 
by  considering  pairwise  neighbors  in  a  spanning  tree  T  in  t/di-disk(icmm,  v(k)rctT)  at 
{(Pi,  vi)}ie{i,...,n}  ■  Then  the  Shostak  extension  of  C  is  itself. 

Proof.  Consider  a  simple  loop  of  G(C)  with  the  initial  vertex  i  £  {0, 1, . . . ,  n}. 
Consider  an  admissible  triple  sequence  P  associated  with  the  loop.  Since  ,  bjj  £ 

{-1,  +1},  for  all  i,j  £  {l,...,n},i  /  j,  and  do,i,  cii.o,  &»,o,  &o,»  €  {-1,  0,  +1},  for  all 
i  £  {1, . . . ,  n},  the  residue  of  P,  (ap,  bp,  dp),  is  such  that  ap  +  bp  =  0.  Hence,  no  new 
inequality  must  be  added  to  obtain  the  Shostak  extension  of  C.  □ 

Lemma  B.3.  Let  C  be  the  system  of  inequalities  of  the  form  (B.2)  obtained  by  con¬ 
sidering  pairwise  neighbors  in  a  spanning  tree  T  of  depth  at  most  k  in  f/di-disk(^cmm,  v(k)rc tr) 
at  {(pi,  nj)}j£{i,. ..,«}•  If  v(k)  =  then  there  is  no  infeasible  simple  loop  in  G(C). 

Proof.  Looking  at  figure  B.l  it  is  clear  that  there  are  two  types  of  simple  loops 
with  admissible  triple  sequences  in  G(C): 
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(i)  (+1,  — (+1)- or  (  —  1)  +1)  (~ 1>  +1, 

where  ij'g{0,...,n-l}  and  {i,j}  is  an  edge  in  T. 

(ii)  (0,  — 1,  gg),  (+1,-1,  Siltia), (+1,  — 1,  i5ii_i.il),  (+1, 0,  gg)  or 

(0;  +1;  g§)i  (_li  +1>  <5  •  ••  !  (  — 1)  +1,  (~ lj  0,  gg); 

where  it  £  {1, . . . ,(}  for  all  l  €=  {1, . . .  ,C}  and  is  an  edge  in  T. 

The  residue  for  the  first  set  of  loops  is  (+1,-1,  S;j  +  Sj .j)  or  (—1,  +1, 5 +  Sjj).  The 
feasibility  condition  is  trivially  satisfied  by  construction  since  S;j  +  Sj.;  >  0.  For  the 
second  set  of  loops,  the  residue  is: 


(o,  -1,  +)  O  (+1,  -1,4,1, >  0  ■  ■  •  0  (+1,  -1, 4_„it)  a  ( +  i,o, 

=  (0,0,2^ +  !>„„„), 


or 


(o, +1,^)0  (-1,  +i,  4,1, >  0  ■  ■  ■  0  (-1, +1,4,1<_.)  ©  ( - 1,0, 

In  order  to  guarantee  the  feasibility  of  the  second  set  of  loops,  we  need  that  2gg  + 

^2^1=1  <5ii,ii+i  >  0.  We  derive  conditions  for  the  worst  case  which  occurs  when  the  loop 
is  written  for  the  longest  path  in  T,  i.e. ,  when  (  =  k+1  and  when  Siuil+1  =  —v{k)rc tr, 
for  all  l  £  {1, . . . ,  k}.  In  this  case,  there  is  no  infeasible  simple  loop  if  and  only  if 

2^=  -  kv(k)rctI  >  0, 
that  is,  if  and  only  if  v[k)  =  □ 

Finally,  the  proof  of  Theorem  3.5  follows  from  Theorem  B.l,  Lemma  B.2  and 
Lemma  B.3. 


19 


